Insertion robotisée d'une aiguille flexible par asservissement visuel échographique

The robotic guidance of a needle has been the subject of a lot of research works these past years to provide an assistance to clinicians during medical needle insertion procedures. However, the accurate and robust control of a needle insertion robotic system remains a great challenge due to the complex interaction between a flexible needle and soft tissues as well as the difficulty to localize the needle in medical images. In this thesis we focus on the ultrasound-guided robotic control of the trajectory of a flexible needle with a beveled-tip. We propose a 3D model of the interaction between the needle and the tissues as well as a needle tracking method in a sequence of 3D ultrasound volumes that uses the artifacts appearing around the needle. Both are combined in order to obtain good performances for the tracking and the modeling of the needle even when motions of the tissues can be observed. We also develop a control framework based on visual servoing which can be adapted to the steering of several kinds of needle-shaped tools. This framework allows an accurate placement of the needle tip and the compensation of the physiological motions of the patient. Experimental results are provided and demonstrate the performances of the different methods that we propose.Le guidage robotisé d'une aiguille a été le sujet de nombreuses recherches ces dernières années afin de fournir une assistance aux cliniciens lors des procédures médicales d'insertion d'aiguille. Cependant le contrôle précis et robuste d'un système robotique pour l'insertion d'aiguille reste un grand défi à cause de l'interaction complexe entre une aiguille flexible et des tissus ainsi qu'à cause de la difficulté à localiser l'aiguille dans les images médicales. Dans cette thèse nous nous concentrons sur le contrôle automatique de la trajectoire d'une aiguille flexible à pointe biseautée en utilisant la modalité échographique comme retour visuel. Nous proposons un modèle 3D de l'interaction entre l'aiguille et les tissus ainsi qu'une méthode de suivi de l'aiguille dans une séquence de volumes échographiques 3D qui exploite les artefacts visibles autour de l'aiguille. Ces deux éléments sont combinés afin d'obtenir de bonnes performances de suivi et de modélisation de l'aiguille même lorsque des mouvements des tissus sont observés. Nous développons également une approche de contrôle par asservissement visuel pouvant être adaptée au guidage de différents types d'outils longilignes. Cette approche permet d'obtenir un contrôle précis de la trajectoire de l'aiguille vers une cible tout en s'adaptant aux mouvements physiologiques du patient. Les résultats de nombreux scénarios expérimentaux sont présentés et démontrent les performances des différentes méthodes proposées

Online prediction of needle shape deformation in moving soft tissues from visual feedback

International audience— With the increasing number of clinical interventions using needle shaped tools, robotic control of needle insertion procedures has been an active research field for many years. In this work we propose a 3D model of a flexible needle that takes into account tissue deformations in order to predict the needle shape and trajectory when it is inserted using a robotic arm. To account for tissue displacements, we designed a method based on visual feedback that updates the interaction model between the needle and the tissue using an unscented Kalman filter. Results obtained from several needle insertions in a soft tissue phantom showed that the method gives good performance in terms of needle trajectory prediction. This model was also considered in a closed-loop control approach to allow automatic reaching of a target

Real-time Teleoperation of Flexible Beveled-tip Needle Insertion using Haptic Force Feedback and 3D Ultrasound Guidance

International audienceNeedle insertion procedures can greatly benefit from robotic systems to improve their accuracy and success rate. However, a fully automated system is usually not desirable and the clinicians need to be included in the control loop. In this paper we present a teleoperation framework for beveled-tip flexible needle steering that enables the user to directly and intuitively control the trajectory of the needle tip via a haptic interface. The 6 degrees of freedom of the needle base are used to perform several automatic safety and targeting tasks in addition to the one controlled by the user. Real-time visual feedback is provided by a 3D ultrasound probe and used to track the 3D location of the needle and of a spherical target. Several haptic force feedback are compared as well as two different levels of mix between automated and user-controlled tasks. A validation of the framework is conducted in gelatin phantom and a mean targeting accuracy of 2.5 mm is achieved. The results show that providing an adequate haptic guidance to the user can reduce the risks of damage to the tissues while still letting the surgeon in control of the tip trajectory

Needle Steering Fusing Direct Base Manipulation and Tip-based Control

International audienceWorks on robotic needle steering often consider either tip-based control of flexible beveled tip needles or control of the bending of symmetric tip needles. In this paper a control law for needle steering which uses both direct manipulation of the needle base and the control of the tip deflection, is proposed. A 3D model of a beveled tip needle is used to determine the base motion that is needed to obtain the desired tip motion. The needle-tissue interaction model uses local virtual springs placed along the needle shaft and takes into account the interaction forces at the bevel. Online estimation and update of this model parameters is performed via visual feedback. The low level controller uses the task function framework to allow control of the tip velocity. Additionally duty cycling method is used if a reduction of the natural deflection of the needle tip is needed. Finally an experimental targeting task in a gelatin phantom is presented for preliminary validation of the framework. The method provided sub-millimeter accuracy on a target that would be unreachable using only tip-based control

Flexible Needle Steering in Moving Biological Tissue with Motion Compensation using Ultrasound and Force Feedback

International audienceNeedle insertion procedures under ultrasound guidance are commonly used for diagnosis and therapy. It is often critical to accurately reach a targeted region, and this can be difficult to achieve due to intra-operative tissue motion. In this paper, we present a method to steer a beveled-tip flexible needle towards a target embedded in moving tissue. Needle steering is performed using a needle insertion device attached to a robot arm. Closed-loop 3D steering of the needle is achieved using tracking of an artificial target in 2D ultrasound images and tracking of the needle tip position and orientation with an electromagnetic tracker. Tissue motion compensation is performed using force feedback to reduce targeting error and forces applied to the tissue. The method uses a mechanics-based interaction model that is updated online. A novel control law using task functions is proposed to fuse motion compensation, steering via base manipulation and tip-based steering. Validation of the tracking and steering algorithms are performed in gelatin phantom and bovine liver. Tissue motion up to 15mm is applied and average targeting error is 1.2±0.8mm and 2.5±0.7mm in gelatin and liver, respectively, which is sufficiently accurate for commonly performed needle insertion procedures